#natural gradient29/08/2025
Cut AI Training Costs by 87% with Oxford’s FOP — 7.5× Faster ImageNet Training
'Oxford researchers introduce FOP, an optimizer that leverages intra-batch gradient variance to achieve up to 7.5× faster convergence and drastically lower GPU costs.'